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[57] ABSTRACT 

An imaging system, which improves the optical revolu- 
tion and reduces optical alias of a solid state imager 
comprises a lens and a modulating element, which alters 
incident radiation in such a manner as to displace the 
image by fractions of a pixel between adjacent fields by 
either mechanically shifting the elements or by electro- 
optic variations of refractive index. A processing sys- 
tem is also provided, in which alternate fields are inter- 
laced and output to a monitor. The modulator is ar- 
ranged in a demountable manner, so that it can be 
"bolted on" as an additional attachment to a standard 
camera. The processing system is attached via the origi- 
nal CCD output terminal. 

11 Claims, 6 Drawing Sheets 
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Fig. 3b) SIGNAL AFTER CHOPPING AND 
SAMPLING 



Fig. 3c) THE CCB SENSES AND SAMPLES 
THE SECOND FEW OF THE IMAGE 



Fig. 3d) SIGNAL AFTER CHOPPING AND 
SAMPUNG 



Fig. 3ej SIGNAL PERCEIVED BY THE 
HUMAN EYE 
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IMAGING SYSTEM HAVING A SWING-DRIVEN 
IMAGE SENSOR 

BACKGROUND OF INVENTION 

1. Held of Invention 

This invention relates to an imaging system and in 
particular it relates to apparatus for improving the reso- 
lution and reducing the optical alias of imaging systems 
which include a solid state image sensor such as a CCD 
sensor. 

2. Description of the Prior Art 
In a conventional scanned imaging system using a 

solid state sensor, electromagnetic radiation, generally 
either optical or infra red is admitted by a lens system to 
an array of imaging elements which may be charge 
coupled devices (CCD's). The CCD array is scanned 
and an output is taken from each element in turn which 
is dependant upon the light incident upon that element. 
This output is processed and used to modulate the dis- 
play on a monitor and thus to produce an image upon 
the monitor. The resolution of such a system is depen- 
dant upon the size and number of the CCD elements 
within the sensing array. Current technology limits this 25 
size to a sensor of a maximum of perhaps 600X600 
elements each of around 10 micron dimensions. 

An image is generally viewed over two scanning 
fields. In the first field the 1st, 3rd, 5th etc. lines of the 
array are scanned and during the second field the 2nd, 
4th etc. lines are scanned. The processing system then 
interlaces the two fields upon a display monitor and the 
human eye and brain performs an integrating function 
to see the entire image. Typically the scanning time for 
one field is 50 Hz and thus the whole picture is re- 
freshed with a frequency of 25 Hz. 

In order to improve the resolution of such a system, 
it has been suggested to shift the image position with 
respect to the sensor by half a pixel or integer and a half 
pixel during each alternate field. If the shift is made in 
the horizontal direction then the horizontal resolution 
of such a system can be effectively doubled since the 
slight shifting of the image tends to effectively half the 
length of an imaging element and thus to double the 
total number of elements which are apparently used to 
view each horizontal line of the image. In order that the 
picture does not flicker on the monitor it is important 
that, after sensing, the video signals are shifted back by 
half pixel or integer and one and a half times in synchro- 
nism with the shift of the image. It has been suggested to 
shift the image either by altering the position of the 
CCD slightly or to alter the angle of a glass plate or 
mirror placed between the lens and imaging sensor. The 
present invention arose from a need to maintain the 
resolution increase whilst also reducing the degrading 
effects of aliassing. Also, it was required to provide a 
system which can use a standard CCD camera. 

SUMMARY OF THE INVENTION 

According to the present invention there is provided 
an imaging system comprising an array of solid state 
im agi n g elements adapted to be sampled sequentially at 
a pixel rate; means for optically shifting an image rela- 
tive to a sensor in adjacent time integration periods; 
means for processing the received information such that 
it remains spatially co-incident in adjacent time periods, 
and; secondary sampling means for sampling a portion 
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of the received information at a sampling rate synchro- 
nous to the pixel rate. 

The adjacent time integration periods may be fields 
or frames of a T.V. picture and the image may be shifted 
by half a pixel pitch or integer and one and a half times 
the pixel pitch in adjacent T.V. fields. 

The secondary sampling means may be adapted such 
that the sampling sites for display or further processing 
are adjacent in each integration period, i.e. when two 
fields are interlaced to form a T.V. image the sampling 
sites form a "checker board" type of display. 
The imaging sensor may comprise a CCD array. 
The invention thus not only improves the resolution 
of an imaging system but also reduces the optical alias of 
the sensors. By virtue of its sampling action the solid 
state image sensor produces an abas in both vertical and 
horizontal senses. The method according to the inven- 
tion enables a reduction in this alias to be realised. 

Although generally the image will be shifted in the 
horizontal direction it could also be shifted in the verti- 
cal direction or in a combination of both directions. The 
image shifting element may be a glass block or mirror 
placed between a lens and the imaging' sensor. 

In one embodiment modulation is performed by 
means of piezo-eiectic bimorphs. Such bimorphs are 
well known and can provide a fast controllable degree 
of oscillation. For currently available CCD arrays, the 
photodetector pitch is in the range 7.5 to 22 microns, so 
the half pixel image displacement required is in the 
region of 4 to 11 microns. Assuming a 5 micron shift is 
required, from a glass block of 5 mm thickness the angu- 
lar rotation required is around 2 milliradians and this 
can be controllably achieved by using piezo-electric 
bimorphs in the manner further described below. 

Alternatively, the element may be of a material 
whose refractive index n, or another parameter, can be 
changed under the influence of an electric or magnetic 
field. In such a case, electro-optic means are provided to 
alter n, and hence displace the image, between fields. 

The resampling may be achieved by using a chopping 
modulator sampling only a portion of the received out- 
put from each array element and blanking the remain- 
der of the output. 

Alternatively, resampling may be achieved by digital 
methods using a field store with appropriate delays built 
in. 

Embodiments of the invention will now be described 
by way of example only with reference to the accompa- 
nying drawings in which; 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows schematically apparatus according to 
the invention, and 

FIGS. 2a-Zb show two alternative methods of 
mounting the glass plate on piezo-electric bimorphs. 

FIGS. 3a-3eshow representative outputs from the 
system; 

FIG. 4 shows an alternative embodiment involving 
digital techniques; 

FIG. 5 shows an optical shifting arrangement, and; 
FIG. 6 shows an alternative optical shifting arrange- 
ment. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

Referring to FIG. 1, in an optical imaging system a 
lens 1 is arranged to direct radiation, generally either 
optical or infra-red, through a glass plate 2 to an imag- 
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ing sensor 3. The sensor comprises an array of CCD received field is displayed on monitor 9 or used for any 

imaging elements, typically a 600x 600 array. A signal further processing which is desired. 

output from sensor 3 is filtered by a low pass filter 4 and After the first field has been received then the glass 

directed to standard video processing circuitry 5. The block is tilted by means of the bimorphs to a second 

output from this is directed either directly to a chopping 5 position shown by the dotted lines of FIG. 1. It will be 

modulator 6 or indirectly to the chopping modulator by appreciated that this tilting has the effect of displacing 

means of a half pixel delay line 7. The chopping modu- the image slightly relative to the sensor elements. It is 

lator 6 is synchronised with clocking signals serving a arranged such that the image is displaced by half a pixel 

scanning function for reading the ouputs of the sensor or by integer and half times. The displaced image is then 

elements 3 by means of a clock generator 8. The output 10 scanned by the sensor, sent through the same processing 

from the chopping modulator is displayed on the moni- circuitry 4 and 5 and switchably fed to a delay line 7. 

tor 9, or alternatively may be used for further process- This serves to delay the video by half a pixel for the 

ing as desired. The glass plate 2 is arranged to be tilted reasons outlined above and so as to maintain the picture 

slightly and go back and forth by a driver 10 at a rate position constant on the monitor. The delay line may be 

synchronous with the integration period rate of the 15 external to the basic video camera and infact in embodi- 

sensor, i.e. with the field rate of the system. ments of invention all the non-standard parts of the 

The system is thus basically a standard CCD element system may be external to a standard camera and thus 

imaging system with the further addition of an image * e svstem 58 implementable without requiring 

shifting means 2, a switchable delay 7 and chopping modification of a camera. After passing through the 

modulator 6. The imaging sensor 3 is driven at a rate 20 dela y ^» video for *f sec ° nd j^Id is secondary 

deterrnined by the clock generator 8 such that it scans T^ 1 ? b u v topping modulator 6 and fed to monitor 9. 

an image fieldwise; i.e. in a first field lines 1, 3, 5 etc of "G. 3c shows the signals received by the system rela- 

an image are scanned and in a second field lines 2, 4 etc ? ve v t0 object aft 5 r * e of ^ Iine 7 - FIG 

are scanned. The complete image frame is made up by „ 3 ( sho . ws * e «gnals after secondary samplmg or 

interlacing the two received fields. A typical frame rate 25 c * op P m S " duh f r V** 0 ?" 1 fl f ld 18 d f 
is 25 Hz played on the momtor. The effective picture actually 

The glass plates 2 may conveniently by tilted by ? ee ? °" ^monitor * as shown in FIG. 3. since the eye 
means of piezoelectric bimorphs, as shown in FIGS ^JL^JSS^t.'^T \ V P " d 
2aand 2b A piezoelectric bimorph comprises two , ft thus sees both fields together mterlaced in the manner 
i ^ C . j , *~1T T 1 ^ . 30 shown m FIG. 3c. The eye thus performs an integration 
piezo-electnc sheets 11 and 12 bonded onto respective „„j =, • _ , ; l Y , V. . 

. „ . _ . . . . „ _ . . .. y ... function and it is seen that a high resolution picture is 
2£«t J5if£ * Polarisation of the obtained ^ signa fwould cause blurring 

plates is arranged so that one plate contrac s when a betW een adjacent pixel elements. 
h^JlS Tt^ f to ^ chopping modulator should run at pixel rate and 

hm to««^*«dft Two different 35 be synchronised to the pixel readout rate. This may also 
methods of using such bimorphs are shown in the fig- be extemal to ^ came ^ 

ures. In FIG. 2a four bimorphs are connected to respec- FIG. 4 shows an alternative embodiment in which 
fave corners of an axlel4 which lies in a plane perpen- signa i s rece ived from the video camera, which includes 
dicular to the paper The glass block is mounted trans- ^ m 3 md processing circuitry 4 and 5, are 

versely along the axle. Thus, by applying the voltages 40 split mt0 ^ md low frequency components by filters 
as shown to the bimorphs the angle of the axle and 15 ^ 16 respectively and digitised by ADC's 17 and 
hence the gtoss block 3 is controllably altered, depen- 18 , During receipt of the first field, signals representa- 
dant upon the voltage appheo\By reversing the applied tive of the high frequency component of each pixel 
voltage the angle is reversed FIG. 2b shows an alterna- dement m ^ led such ^ a le x to jjf ^ 
tive embodiment wherein the bimorphs are connected 43 length of each pixel element is stored in every other 
to the axle by means of hinges. memory location of one of two field stores forming a 

The use of the apparatus of FIG. 1 will now be de- frame store 19. As each signal is sequentially received 
scribed During receipt of the first field of the image the the sampled portion of it is stored in every other mera- 
sensor3 is clocked by generator 8 at its normal clocking ory elemen t of that field store. During receipt of a sec- 
rate. The glass plate for the first field is situated at one 50 ond field, the image of which has been shifted with 
particular angle shown by the solid line on the figure. reS pect to the sensor by the glass block, each received 
After low pass filtering, standard video processing and pixel element is sequentially sampled as for the first field 
further filtering is applied within box 5. The processed and is placed in the empty locations of the first field 
video signals are then sent sequentially direct to chop- store such that after receipt of the complete field, that 
ping modulator 6 which is arranged as a square wave of 55 field store is filled with, alternatively, data representa- 
frequency 1 1.25 MHz. This is equal to the pixel rate tive of respectively the first field and second field. The 
deterrnined by clock generator 8 which is used to se- whole resulting frame is then sent out from the field 
quentially sample the relevant elements of the imaging store where it is mixed with the low frequency compo- 
sensor 3. Thus, since a chopping modulator is a square nent of the second, i.e. current, field. The whole recov- 
wave of approximately 50% duty cycle, then, in effect, 60 ered signal is then reconverted to analogue form in a 
half of the received output from each array element is digital to analogue converter 19. Sync signals, etc. are 
blanked out. This effect is shown more clearly in FIGS. added at unit 20 and the video signal subsequently dis- 
3a and b where in FIG. 3a signals arriving at the input played. The displayed video signal is thus as shown in 
of the chopping modulator are shown and these are FIG. 3e except that all the picture elements are in effect 
spatially representative of the array element configure- 65 moved up one row i.e., the elements shown as Li are 
tion. After chopping, the position of FIG. 3b is reached moved down to the second line L 2 and fill the gaps 
in which half the signals are allowed to continue un- between the elements in line L2. Since there are two 
modulated and half are in effect blanked out. The thus field stores present in a frame store, while each field 
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store is being read out a second field store is being filled 
and thus the third line of the video display wiU' show 
that information currently in line Lj of FIG. 3e inter- 
laced with the information currently in L2. Similarly the 
fourth line will contain the information currently in the 5 
fourth line interlaced with that currently in the third 
line. i.e. the overall effect is of vertical bars each of two 
lines in the vertical dimension and one square of hori- 
zontal dimension. Hence, the increase in resolution and 
also the reduction in aliassing is maintained. The picture 10 
actually seen by the' eye is the same as that for the first 
embodiment since the eye itself performs the vertical 
integration function over adjacent pixels in the first 
embodiment. 

The low frequency output from the camera is not 15 
processed by the field store since the vertical resolution 
is effected by low frequency information and processing 
the LF information would tend to degrade vertical 
resolution. The use of digital techniques considerably 
reduces the performance requirements of the monitor 20 
and also all the digital apparatus may be external to the 
camera, thus can in effect be a "bolt on" addition to a 
standard camera. 

In further embodiments, shown in FIGS. 5 and 6, the 
image shifting is performed by changing a physical 25 
property of the refracting glass block, mirror or lens. 
For example by imposing an altering electrical field 
across at least two faces of the block. 

Preferably the modulation of incident radiation in 
such an embodiment is characterised by the altering of 30 
the refractive index of the transparent glass, typically 
by an alternating voltage. An example of such a mate- 
rial is Cadmium Mercury Telluride (CMT). This is a 
"glass" which is transparent to a broad waveband of 
light The inherent advantage of using such an optical 35 
shifting system is that it is faster, more reliable, more 
responsive and less likely to suffer "wear-and-tear" 
damage. This final point is especially important when 
considering, not so much the block, but the modulating 
means and its attachments. 40 

FIG. 5 shows two substantially parallel blocks of 
transparent Cadmium Mercury Telluride (CMT) (2g 
and 2h). Attached to each of these blocks are electrodes 
62a 62b r 12a and 12b respectively. A first modulation 
controller 52/ modulates the refractive index across two 45 
faces, thereby refracting radiation in one plane, whilst a 
second modulation controller, S2g varies the refractive 
index in a different sense and thereby refracts radiation 
in a different plane. In the preferred embodiment the 
two planes are orthogonal. . 50 

FIG. 6 shows a single block (2/) arranged to modu- 
late in two orthogonal planes, the control of said modu- 
lation being performed by controllers 52/ and S2g 

Apparatus according to the present invention may be 
used with any convenient type of solid state imager or 55 
self scan imagers such as staring arrays. 

Certain types of infra-red imagers require a thermal 
difference in detected radiation in order to function 
correctly. The action of the image shifting device 2 of 
the present invention may be used to provide this radi- 60 
ant difference for the sensor. 

I claim: 

1. An imaging system comprising: 
an array of solid state imaging elements for producing 

an image signal corresponding to an optical input 65 

to said imaging elements; 
means for optically shifting said optical input out of 

spacial coincidence, in synchronism with a pixel 
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rate so that the image signal produced by said array 
is out of spacial. coincidence; . ■ 

primary sampling means for sequentially sampling the 
out of coincidence image signal from said imaging 
elements at a pixel rate to produce an out of spacial 
coincidence field signal; 

means for processing the out of coincidence field 
signal to produce a video signal for display of said 
field signal in spatial coincidence, representative of 
the optical input; 

and secondary sampling means for sampling the 
video signal at a rate synchronous to said pixel, rate, 
including a chopping modulator for generating a 
square waveform synchronous to said pixel rate 
wherein said video signal is sampled by said sec- 
ondary sampling means during every, other half 
cycle of said waveform. 

2. An imaging system as claimed in claim 1 wherein 
said means for optically shifting the image includes an 
element having a refractive index, and means for oscil- 
lating said element in synchronism with said pixel rate 
to shift the optical input • . 

3. An imaging system as claimed in claim 2 wherein 
the element is mounted by means of piezo-electric bi- 
morphs. 

4. An imaging system as claimed in claim 1 wherein 
said means for optically shifting includes an optical 
element having a refractive index, and electro-optic 
means for modulating said refractive index to shift said 
optical input 

5. An imaging system as claimed in claim 4 including 
means for providing at least one potential field across 
the optical element and means for switching the field 
between two states. 

6. An imaging system as claimed in claim 4 wherein 
the element is of cadmium mercury telluride. 

7. An imaging system comprising: 

an array of solid state imaging elements for producing 
an image signal corresponding to an optical input 
to said imaging ^elements; 

means for optically shifting said optical input out of 
spacial coincidence, in synchronism with a pixel 
rate so that the image signal produced by said array 
is out of spacial coincidence; 

primary sampling means for sequentially sampling the 
out of coincidence image signal from said imaging 
elements at a pixel rate to produce an out of spacial 
coincidence field signal; 

digital storage means including means for processing 
the out of coincidence field signal to produce a 
video signal for display of said field signal in spacial 
coincidence, and secondary sampling means for 
sampling the video signal at a rate synchronous to 
said pixel rate. 

8. An imaging system as claimed in claim 7 wherein: 
said field signal has a high frequency component and 

a low frequency component, 

the high frequency component of said field signal is 
processed by said storage means and 

the low frequency component is removed from said 
field signal and added to the processed high fre- 
quency component after storage. 

9. An imaging system as claimed in claim 8 wherein 
said means for optically shifting the image includes an 
element having a refractive index, and means for oscil- 
lating said element in synchronism with said pixel rate 
to shift said optical input. 
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10. Imaging apparatus for usewitli a video camera of 
the type including a solid state sensor for sensing radia- 
tion impinging thereon, comprising: 

means for optically shifting the radiation before it 5 
impinges upon the sensor so as to shift an image 
relative to the sensor between adjacent time inte- 
gration periods; 

means for processing a signal output from the camera 
such that said signal is restored to spatial coinci- 10 
dence in adjacent time periods; and 

means for sampling a portion of the processed signal 
at a sampling rate synchronous to a pixel rate; 

wherein the imaging apparatus is demountable from 
the camera. 

11. An imaging system comprising: 

an array of solid state imaging elements for producing 
an image signal corresponding to an optical image 
input; 20 



means for optically shifting said optical image input 
between a first optical position and a second optical 

. position out of spacial coincidence wit said first 
position, in synchronism with a pixel rate, 

means for sequentially sampling said image signal 
from said image elements at said pixel rate, and for 
producing a first field signal from said image signal 
corresponding to said first optical position and a 
second field signal from said image signal corre- 
sponding to said second optical position; 

means for combining said first and second field sig- 
nals to produce a video signal representative of said 
first and second field signals combined in spacial 
coincidence; and 

secondary sampling means including a chopping 
modulator adapted to generate a square wave 
waveform, for sampling said video signal during 
every other half cycle of said waveform at a rate 
synchronous to said pixel rate. 
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